Adaptive Multi - Modal Person Verification System
نویسنده
چکیده
This paper describes an adaptive multi-modal person verification system based on speech and face images. The system adapts to noise present in the speech signal by modifying the parameters of the fusion module. Linear and Support Vector Machine (SVM) based techniques of fusing the similarity measures from speech and face modes are investigated. Experimental results obtained on the Digit Database show that the adaptive system significantly outperforms its non-adaptive counterpart.
منابع مشابه
Training Method of a Piecewise Linear Classifier for a Multi-modal Person Verification System
In this paper we propose a training method for a Piece-wise Linear (PL) binary classifier used in a multi-modal person verification system. The training criterion used minimizes the false acceptance rate as well as false rejection rate, leading to a lower Total Error (TE) made by a multi-modal verification system. The performance of the PL classifier and Support Vector Machine (SVM) binary clas...
متن کاملInformation Fusion and Person Authentication Using Face and Fingerprint Data
This paper describes the integration of face and fingerprint data to improve the performance of a person identity verification system. In the conetxt of multi-modal person authentication, a set of experts give their opinion as a scalar number, called score, about the identity of an individual. A fusion module receiving as input the scores has to take a binary decision: accept or reject the clai...
متن کاملStructurally noise resistant classifier for multi-modal person verification
In this letter we propose a piece-wise linear (PL) classifier for use as the decision stage in a two-modal verification system, comprised of a face and a speech expert. The classifier utilizes a fixed decision boundary that has been specifically designed to account for the effects of noisy audio conditions. Experimental results on the VidTIMIT database show that in clean conditions, the propose...
متن کاملNoise compensation in a multi-modal verification system
In this paper we propose an adaptive multi-modal verification system comprised of a modified Minimum Cost Bayesian Classifier (MCBC) and a method to find the reliability of the speech expert for various noisy conditions. The modified MCBC takes into account the reliability of each modality expert, allowing the de-emphasis of the contribution of opinions from the expert affected by noise. Reliab...
متن کاملNoise compensation in a person verification system using face and multiple speech feature
In this paper, we demonstrate that use of a recently proposed feature set, termed Maximum Auto-Correlation Values, which utilizes information from the source part of the speech signal, signi cantly improves the robustness of a text independent identity veri cation system. We also propose an adaptive fusion technique for integration of audio and visual information in a multi-modal veri cation sy...
متن کامل